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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
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earned patent term adjustment. See 37 CFR 1.704(b). 
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Disposition of Claims 

4) EI Claim(s) U21 i^/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) M Claim(s) 1-11, 13-21 j^/are rejected. 
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DETAILED ACTION 
Claim Objections 

1 . Claim 1 is objected to because of the following informalities: 

In line 15 of claim 1, the term "said threshold" should be changed to - said thresholds - . 

Claim Rejections - 35 USC § 112 

The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

2. Claim 1 recites the limitation "said image" in lines 7 and 9 of claim 1. There is 
insufficient antecedent basis for this limitation in the claim. 

Claim 1 recites the limitation "said relation" in line 15 of claim 1. There is insufficient 
antecedent basis for this limitation in the claim. 

Claim Rejections - 35 USC §102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 
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3. Claims 1 & 13 are rejected under 35 U.S.C. 102(b) as being anticipated by Lu et al (US 
5,504,524). 

Regarding claim 1, Lu discloses an automatic exposure adjusting device, comprising: 

an image sensor (3) having an adjustment capability (e.g., varies integration time as 
shown in col. 4, lines 25-29); 

an analog to digital converter (A/D) which produces a digital output indicative of an 
output of the image sensor (see fig. 2 for A/D block); 

a first counter (indicated by N(l)) which counts a number of overexposed parts (pixels) 
of the image (see fig. 3; col. 4, lines 16-18); 

a second counter (indicated by N(2)) which (indirectly) counts a number of underexposed 
parts (pixels) of the image by counting well exposed pixels for use to calculate underexposed 
pixels (see fig. 3; col. 4, lines 18-28); 

a plurality of threshold detectors which compares counting results of the first and second 
counters with desired thresholds (greater than 1% region, or less than 1% region) (see figs. 3 & 
4; col. 4, lines 16-28; col 6, line 48 - col. 7, line 9); 

a decision element (exposure calculator 17), which makes a decision to either increase an 
exposure of the image sensor or decrease an exposure of the image sensor based on the relation 
with the threshold (see col. 7, lines 10-19). 



• * 
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Regarding claim 13, Lu also teaches that the exposure is one of a shutter width (e.g., 
variation of the sensor cell integration time) or a gain of the image sensor as clearly shown in 
col. 4, lines 35-40; col. 6, lines 29-35. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claim 11 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lu et al (US 
5,504,524). 

Regarding claim 11, Lu does not explicitly disclose that the image sensor includes an 
active pixel sensor with a plurality of pixels of CMOS image sensor, each pixel including an in- 
pixel buffer transistor and in-pixel selection transistor. However, an Official Notice is taken for 
such active image sensor, which is well known in the art for use in imaging devices as an 
advanced CMOS image sensor that integrates necessary features in a self-contained pixel for 
electronic shuttering, anti-blooming purposes, etc. . .as well as reducing circuit size. 

Therefore, it would have been obvious to those skilled in the art to use the active image 
sensor as an advanced CMOS sensor for electronic shuttering, anti-blooming purposes, etc... as 
well as reducing circuit size. 
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5. Claims 2-9, 14-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Lu et 
al (US 5,504,524) in view of Baumeister (US 4,684,995). 

Regarding claims 14, Lu discloses automatic exposure adjusting image sensor device, 
comprising: 

an image sensor (3), including a plurality of adjustable photodetectors (e.g., integration 
time), each photoreceptor defining a pixel of the image, and the image sensor having an 
adjustable exposure which when increased, increases an amount of exposure, and when 
decreased, decreases an amount of exposure (see figs. 2-4; col. 4, lines 21-28; col. 6, lines 29-34 
&col. 7, lines 10-19); 

an analog to digital converter (A/D) which obtains an analog output from the image 
sensor and produces a digital output indicative of the analog output to thereby produce a plurality 
of digital outputs for the plurality of pixels (see fig. 2 for A/D block, wherein its digital output 
signals are taken from the image detector and fed into digital exposure and color balance 
controller); 

a pixel characterization element (threshold level detectors 13a-c with combining means 
14) characterizing the pixel according to its exposure characteristics (i.e., high output from gate 
15a indicating the color channel intensity exceeds V3, which falls in overexposure region of 
BAND 3, as described in figs. 3 & 4; col. 6, line 48 - col. 7, line 9); 
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a counter element (exposure judgment controller 16 including N(l) & N(2)), which 
counts numbers of pixels characterized by the pixel characterization element and compares the 
count with certain thresholds (see col. 7, lines 2-14); 

an image adjusting element (exposure calculator 17), which adjusts the exposure based 
on the count (see col. 7, lines 10-19); 

Although Lu does not explicitly teach that the pixel characterization element investigates 
only certain most significant bits of at least a plurality of the digital outputs, Baumeister clearly 
teaches the most significant bits (MSB) are used for determining the exposure level of the pixels 
since the MSB of the pixel information provide sufficient image information for exposure 
measurement as described in col. 2, lines 18-20 & lines 54-57. 

Therefore, it would have been obvious to one of ordinary skill in the art to use the 
teaching of the most significant bits (MSB) for exposure measurement from Baumeister in Lu's 
digital exposure controller since the most significant bits of the pixel information provide 
sufficient image information for exposure measurement. 

Regarding claim 15, Lu inherently teaches a memory storing the thresholds. As shown in 
fig. 4, col. 6, lines 48-57, the threshold levels VI to V4 (corresponding to BAND 1 to BAND 4) 
must be set or stored in a memory in order for Lu's camera system to function as disclosed. 

Lu does not disclose that the memory is variable to change the threshold. However, it 
would have been well known in the art to use some kind of programmable memory, such as 
EEPROM for storing threshold levels so that the user could change the threshold levels by re- 
programming the memory with new thresholds. 
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Therefore, it would have been obvious to those skilled in the art to make use of the 
programmable memory, such as EEPROM for storing threshold levels so that the user could 
change the threshold levels by re-programming the memory with new thresholds. 

Regarding claim 16, the claimed limitations are met in the analysis with respect to claims 
14 & 15. In addition, normally-exposed pixels are characterized in BAND 2 (well exposed) as 
shown in fig. 4, col 4, lines 18-21. 

Regarding claim 17, the claimed limitations are met in the analysis with respect to claim 

14. 

Regarding claim 2, the claimed limitations are met in the analysis with respect to claim 

14. 

Regarding claims 3 & 18, Lu teaches the first counter counts a number of pixels that are 
overexposed representing "1" (high output) which exceeds V3 (belongs to BAND 3) as 
described in figs. 3 & 4, col. 6, lines 48-67, and Baumeister teaches exposure measurement based 
upon the most significant bits of the pixel information as described in col. 2, lines 18-20 & 54- 
57. 

Someone skilled in the art would motivate to combine the teaching of both Lu and 
Baumeister to end up with a solution for exposure measurement and control utilizing at least one 
of"!" (further limit "11") of the most significant bits detected as overexposed pixels since such 
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information is sufficient enough for exposure measurement and control in an imaging device as 
suggested by Baumeister in col. 2, linesl8-20 & 54-57. 

Therefore, it would have been obvious to those skilled in the art to motivate to implement 
the representation of at least one of "1" (further limit "11") of the most significant bits as an 
overexposed pixel information for the digital exposure measurement and control in an imaging 
device. 

Regarding claims 4 & 19, for the similar analysis as discussed in claim 3, it would have 
also been obvious to those skilled in the art to recognize the representation of "0" of the most 
significant bits as underexposed pixel information for the digital exposure control measurement 
and control in an imaging device. 

Regarding claim 5, the claimed limitation is encompassed by claim 4, wherein at least 
one zero ("0") has been detected as an underexposed pixel information. 

Regarding claim 6, Lu also discloses the threshold detector include values indicative of 
what percentage of the image have underexposed or overexposed pixels, the decision element 
increasing or decreasing the exposure based on percentages (see col. 7, lines 10-19). 

Regarding claim 7, Lu further discloses that there are two coincidence detectors (e.g., 
15a, 15b) representing relationship with two different thresholds (e.g., V3 or BAND 3, and V2 or 
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BAND 2), one of which is for overexposed image and another of which is for an underexposed 
image (indirectly) as shown in figs. 3 & 4; col. 6, line 58 - col. 7, line 19. 

Regarding claim 8, as disclosed by Lu, the decision element reduces (decrements) an 
exposure time for the overexposed image and increases (increments) the exposure time for the 
underexposed image (see col. 7, lines 14-19). 

Regarding claim 9 5 Lu discloses that there are at least three threshold levels (e.g., V0 - 
V4) corresponding to different exposure bands (e.g., BANDO - BAND4) of the pixels being 
detected as shown in fig. 4. Further, Lu also identifies BAND3 as an over-exposed band 
(voltage level is greater V3), and BAND1 as an under-exposed band (voltage level is less than 
V2) as clearly described in col. 6, lines 48-57. Although Lu does not explicitly disclose that 
BAND 4 is a seriously over-exposed band and BANDO is a seriously under-exposed band, it is 
clearly a suggestion to lead those skilled in the art to recognize the obviousness of BAND4 and 
BANDO as being the over-exposed band and the under-exposed band, respectively. 

Someone skilled in the art would motivate to include at least three the coincidence 
detectors (corresponding to BANDO to BAND4) for detecting at least three different features 
including an over-exposed image, an under-exposed image, seriously under-exposed image and 
seriously over-exposed image because such wide range of exposure detection would provide a 
more accurate exposure control technique over image being taken. 

Therefore, it would have been obvious to one of ordinary skill in the art to recognize the 
suggestion of Lu for detecting at least three different features including an over-exposed image, 
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an under-exposed image, seriously under-exposed image and seriously over-exposed image 
because such wide range of exposure detection would provide a more accurate exposure control 
technique over image being taken. 

Regarding claim 20, the claimed limitations are analyzed with respect to claim 9. 

6. Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lu et al (US 
5,504,524) in view of Baumeister (US 4,684,995)^and in further view of Yamaguchi (US 
5,638,123). 

Regarding claim 10, Lu teaches a threshold storing element for storing digital exposure 
values to control exposure level of an image based on the output from exposure calculator (17) 
as shown in col. 7, lines 14-19. Lu does not teach that the threshold storing element storing first 
and second increase and decrease thresholds, and overexposed or underexposed image being 
increased or decreased by the first threshold, and the seriously overexposed or underexposed 
image being increased or decreased by the second threshold. However, Yamaguchi teaches 
exposure control utilizing different thresholds for adjusting the shutter speeds of a camera. 
According to Yamaguchi, each threshold is used for adjusting a suitable shutter speed, such as 
"very bright" corresponds to "shutter speed up to much degree", "slight bright" corresponds to 
"shutter speed up" and etc. . .(see fig. 3). Specifically, there are two stored thresholds of absolute 
numeric values (i.e., +/- 5 and +/- 1), wherein the "very bright" and "very dark" fall within first 
increase and decrease threshold of absolute numeric 5, which means the shutter speed is 
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controlled by either adding numeric value 5 to or subtracting 5 from current shutter pulse data; 
and wherein the "slight bright" and "slight dark" fall within second increase and decrease 
threshold of absolute numeric 1, which means the shutter speed is controlled by either adding 
numeric value 1 to or subtracting 1 from current shutter pulse data (see figs. 2-6; col. 7, line 58 
- col. 8, line 27). 

It would enhance the exposure control process of the camera by enabling the threshold 
storing element to store the first and second increase and decrease thresholds for controlling the 
corresponding exposure levels of an image since such technique provides "the exposure time T is 
shortened by a time five times greater than the shutter pulse period every field" and "making it 
possible to more finely vary the exposure time" as suggested in col 11, lines 34-36 & col. 13, 



Therefore, it would have been obvious to one of ordinary skill in the art to combine the 
invention of Lu with the teaching of Yamaguchi to make the exposure control system more 
efficiently and to more finely vary the exposure time. 

7. Claim 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lu et al (US 
5,504,524) in view of Baumeister (US 4,684,995) and in further view of Yamaguchi (US 
5,638,123). 



lines 30-31. 



Regarding claim 21, Lu teaches a threshold storing element for storing digital exposure 
values to control exposure level of an image based on the output from exposure calculator (17) 
as shown in col. 7, lines 14-19. Lu and Baumeister do not teach that the threshold storing 
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element storing first and second increase and decrease thresholds, and overexposed or 
underexposed image being increased or decreased by the first threshold, and the seriously 
overexposed or underexposed image being increased or decreased by the second threshold. 
However, Yamaguchi teaches exposure control utilizing different thresholds for adjusting the 
shutter speeds of a camera. According to Yamaguchi, each threshold is used for adjusting a 
suitable shutter speed, such as "very bright" corresponds to "shutter speed up to much degree", 
"slight bright" corresponds to "shutter speed up" and etc... (see fig. 3). Specifically, there are 
two stored thresholds of absolute numeric values (i.e., +/- 5 and +/- 1), wherein the "very bright" 
and "very dark" fall within first increase and decrease threshold of absolute numeric 5, which 
means the shutter speed is controlled by either adding numeric value 5 to or subtracting 5 from 
current shutter pulse data; and wherein the "slight bright" and "slight dark" fall within second 
increase and decrease threshold of absolute numeric 1, which means the shutter speed is 
controlled by either adding numeric value 1 to or subtracting 1 from current shutter pulse data 
(see figs. 2-6; col. 7, line 58 - col. 8, line 27). 

It would enhance the exposure control process of the camera by enabling the threshold 
storing element to store the first and second increase and decrease thresholds for controlling the 
corresponding exposure levels of an image since such technique provides "the exposure time T is 
shortened by a time five times greater than the shutter pulse period every field" and "making it 
possible to more finely vary the exposure time" as suggested in col. 1 1, lines 34-36 & col. 13, 
lines 30-31. 
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Therefore, it would have been obvious to one of ordinary skill in the art to combine the 
inventions of Lu and Baumeister with the teaching of Yamaguchi to make the exposure control 
system work more efficiently and to more finely vary the exposure time. 

Allowable Subject Matter 

Claim 12 is objected to as being dependent upon a rejected base claim, but would be 
allowable if rewritten in independent form including all of the limitations of the base claim and 
any intervening claims. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nhan T. Tran whose telephone number is (703) 605-4246. The 
examiner can normally be reached on Monday - Friday, 8:00am - 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew B Christensen can be reached on (703) 308-9644. The fax phone numbers 
for the organization where this application or proceeding is assigned are (703) 872-9314 for 
regular communications and (703) 872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (703) 306-0377. 
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